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Bayesian maxent lets one integrate thermal physics and information theory points of view in the 
quantitative study of complex systems. Since net surprisal (a free energy analog for measuring 
"departures from expected") allows one to place second law constraints on mutual information 
(a multi-moment measure of correlations), it makes a quantitative case for the role of reversible 
thermalization in the natural history of invention, and suggests multiscale strategies to monitor 
standing crop as well. It prompts one to track evolved complexity starting from live astrophysically- 
observed processes, rather than only from evidence of past events. Various gradients and boundaries 
that play a role in availability flow, ranging from the edge of a wave-packet to the boundary between 
idea-pools, allow one to frame wide-ranging correlations (including that between a phenomenon and 
its explanation) as delocalized physical structures. 
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prime of earth's "age of plants and animals", a quan- 
titative look at what we want to protect about evolved 
complexity is timely as well. 

Historically, information theory since the days of 
Shannon^ and Jaynes^ saw entropy and ensembles 
as tools for applying gambling theory (statistical in- 
ference) to physical systems with large numbers of 
similar and/or identical constituents. This paradigm 7 
has worked its way into many advanced^— and se- 
nior undergraduate^— textbooks on statistical physics. 
However, in spite of the growing application of these 
tools in biological and computer sciences, a solid 'inter- 
disciplinary umbrella' for relating energy and informa- 
tion is still neededi^. Even the simplifications^ that 
it affords to the introductory physics student (with few 
exceptions^) are not yet available in texts. 

The objective in this article is to remind readers of the 
physical context for a Bayesian view of correlations in 
complex systems, and to suggest integrated ways to work 
toward multiscale quantitation. The target audience is 
complex systems researchers in varied fields, as well as 
students in the code-based sciences. Hence we'll start 
slowly, but after the opening section will point to the 
literature where possible for technical specifics. 



II. AUGMENTING THE SUM OF PARTS 



I. INTRODUCTION 

Eric Chaisson in this journal recently discussed the 
evolution of complex systems, and its empirically- 
observed correlation with free-energy density^. This pa- 
per is partly about the need he cites for putting such 
energy flows into an agreeable information-theory con- 
text. However "perched on the dawn" is not the whole 
story, since humans also face a decline in one of their 
major sources of free-energy^. Thus as we (for reasons 
that have nothing to do with fossil fuels^) move past the 



Let's begin with correlation itself, i.e. with quantita- 
tive ways of seeing the whole as more than the sum of its 
parts. Statistics courses often focus on 2nd-moment pair, 
or variance-based, measures like correlation-coefficient 
and covariance. The focus here instead is on logarith- 
mic (e.g. bitwise) measures of correlation, like mutual 
information, which a priori at least operate on all scales. 

In the context of general system theory^, begin by 
defining two subsystems A and B e.g. as individual parti- 
cles, as collections of particles, as individual states (which 
may or may not be occupied with particles) , or as regions 
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or control volumes in and out of which energy and mass 
might flow, etc. Mutual information is defined as what 
you learn about A by knowing B, and vice versa. 

In mathematical terms, one can say for subsystems A 
and B that mutual information 



removable 
parti lion 



M[A\B) =S A + S B -S AB) 



(1) 



where Sa and Sb are uncertainties associated with each 
system taken alone, while Sab is uncertainty about the 
combination given all available information, including 
that associated with correlations. It's relatively easy-22 
to prove that ML4|B] > 0. In a sense, therefore, M[vl|-B] 
is a quantitative measure of how systems A and B taken 
together may be more than the sum of their parts. 

For example, imagine that you have two drawers (A 
and B) for your socks. Suppose you know that each 
drawer contains N socks, and that the socks are identical 
except they are either black or white with equal probabil- 
ity. The amount of uncertainty (average surprisal) about 
the socks in A and B given this information is 2N bits, 
i.e. fcln[2] or one bit for each sock. However, if you also 
know that socks were put into the drawers by breaking 
up matched pairs, one into each drawer, knowledge of 
the content of one drawer will also tell you what's in the 
other. Hence the "two drawer" (whole system) uncer- 
tainty is reduced to N bits. The added knowledge about 
how the drawers were filled therefore provides 2N minus 
TV, or N bits of mutual information. 



A. Non-locality 

Where is the mutual information (i.e. those N bits 
about the state of drawers A and B) physically located? 
One might be tempted to say it's located external to 
system AB, in the observer's database. In fact, it's de- 
localized in that changes to either system AB or its envi- 
ronment (e.g. a forgetful observer) can change things so 
that knowledge of system A proves nothing about system 
B, i.e. could make the mutual information no longer mu- 
tual. Thus mutual information is inherently non-local. 



B. Correlations &: physical entropy 

The mutual information itself (i.e. knowledge that the 
contents of the two drawers are correlated) can come ei- 
ther from the process by which the drawers were filled, or 
from a peek at their contents. Entropy increases in de- 
terministic model physical systems in fact depend on the 
tossing out of correlations between subsystems too small 
to investigate with "a peek" . Thus entropy increases in 
physical systems can be seen as a loss of mutual informa- 
tion between those systems and their environment. 

For example consider a 1-atom bi-partitioned cell like 
the JV-atom cell in Figure [1] Using one of the pistons 
to capture that one ideal gas atom on either side of the 
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independent pi-stans 

FIG. 1: A symmetric bi-partitioned cell for the isothermal 
compression of an N-atom ideal gas into either its left or 
right half, perhaps first discussed by Szilard, which serves 
as a physical system about whose state mutual information is 
available for a well-defined price in free energy. If one is fur- 
ther provided with some mechanism (e.g. spectroscopic) for 
reading its state, it may also serve as a mechanically operated 
single-bit memory. The "setting" process involves removing 
the barrier between compartments, using the piston on one 
side to relocate all atoms into the opposite half and then re- 
turning the barrier before returning the piston to its original 
position. The required work is Win = NkT ln[2]. Its reset 
status may be defined as true if we know that the atoms are 
located in the right half of the container, and false if we don't 
know this to be the case. 



removable partition decreases the entropy of the gas by 
/jln[2] or one bit. If an observer is taking notes, it can 
also increase the mutual information between that gas 
and its environment by one bit since they can afterwards 
answer the true-false question correctly: In which of the 
two partitions does the atom reside? 

To take a more general view, begin with system A hav- 
ing N accessible states so that a priori uncertainty about 
A is Sa = k In N. Then consider an observer B, with suf- 
ficient added information about A to limit the number of 
accessible states to ft < N. Observer B therefore has un- 
certainty about A of Sa/b = khxQ. What we can learn 
about A by knowing B also is then the mutual informa- 
tion between B and A, i.e. ML4|B] = S A - S a /b- The 
Second Law assertion that Sa/b can increase but not de- 
crease with time if systems A and B are isolated thus also 
says quite generally that the mutual information between 
isolated systems A and B can decrease but not increase 
with time. 

Even though delocalized mutual information, and 
physical entropy, are connected in this way, the latter is 
historically treated as an extensive property "distributed 
locally" throughout the system. As shown by equation [TJ 
uncertainty may be treated as extensive i.e. as a sum of 
parts, as long as subsystem correlations within that sys- 
tem (mutual information) may be ignored on the macro- 
scopic scale. Then Sab = Sa + Sb- This is the case with 
many thermodynamic systems, a limiting case of which 
are "ideal gases" that behave as though gas molecules are 
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ignoring one another completely. 



III. MAXENT & NET SURPRISAL 

A robust tool for estimating uncertainties in the face 
of added information might be called "the maxent best- 
guess machine" . The added information is normally writ- 
ten as "expected averages" , although the approach in 
principle can accomodate a wide range of added infor- 
mation types. 

One first writes entropy in terms of probabilities 
by defining for each probability pi a "surprisal" Sj = 
fcln[l/pj], in units determined by the value of k. The av- 
erage value of this surprisal reduces to S = k In Q when 
the pi are all equal, making it simply a logarithmic mea- 
sure of the effective number of accessible states fl = e s ^ k . 
The relationships described here translate seamlessly into 
quantum mechanical terms 6 . 



A. Availability minimization 

The standard problem and its solution has been reit- 
erated myriad times since its statement by Jaynes. The 
bottom line is that the problem of entropy maximiza- 
tion under expectation-value constraints can be recast 
through Lagrange's method of undetermined multipliers 
as a constraint-free minimization of generalized availabil- 
ity in information units. This minimized availability (de- 
fined without reference to any specific physical system 
or conservation laws) , for example^ 3 -, becomes the appro- 
priate free energy for any given thermodynamic ensemble 
when divided by energy's Lagrange multiplier (1/fcT). 



B. Departures & net surprisal 

Although availability (hence free energy) minimization 
is quite useful for locating the most likely states, finite de- 
partures from expected are better measured with whole 
system changes in uncertainty relative to a reference 
stat o ' 25 , or net surprisals. Net surprisal (also called 
the Kullback-Leibler divergence^ 6 , or relative entropy 27 ) 
is defined as 



-fcX>ln(^)>0, 



(2) 



where the p i are state probabilities based only on am- 
bient state information, while the pi take into account 
all that is known. From the solution to the standard 
problem above, one can then show under fairly general 
conditions near ambien t 23 ! 25 that derivatives of availabil- 
ity under ensemble conditions are also derivatives of net 
surprisal. 



For example, systems in thermal contact with an am- 
bient temperature bath may be treated as canonical en- 
semble systems with constrained average energy. Thus a 
temperature deviation from ambient T Q for a monatomic 
ideal gas gives for that system -^r 1 = |iVS[^] where 
5[cc] = x — 1 — In x > 0. If that system is also in con- 
tact with an ambient pressure bath (i.e. able to ran- 
domly share volume and energy), volume deviations add 
NZ[¥-} to the fore going. For grand canonical systems 
whose molecule types might change (e.g. via chemical 
reaction), one instead adds NjE[^-] for each molecule 

type j whose concentration varies from ambien t 23 ' 25 ! 28 . 

Even more specifically, a problem offered to intro 
physics students at the University of Illinois asked how 
cool the room must be for an otherwise unpowered device 
to take boiling water in at the top, and return it as ice 
water at the bottom. Since the 2 nd Law allows conver- 
sion of one form of net surprisal reversibly into another 
(famously without providing any clues how to pull it off), 
one can simply set net surprisals equal for the initial and 
final states, and then solve for T room . 

Of course, the net surprisal measure is not only rel- 
evant to inference about systems for which physically- 
conserved energy is of interest. For example, it meets 
the requirements for an information measure proposed by 
Gell-Mann and Lloyd 2 ^, and includes the Shannon infor- 
mation measure discussed there as a special case. It can 
also be useful in applied statistics, as in the assessment 
of student responses to multiple choice test questions^ 3 -. 



C. A special case 

More importantly, the mutual information measure de- 
fined earlier is a special case. To see this, again consider 
two subsystems. The joint probability that system I is 
in state i and system J is in state j might be written 
p[ij] > 0. This obeys YliYlj P\ij] = 1> where the i in- 
dices run over all possible states for subsystem I, while 
the j indices run over all possible states for subsystem J. 
From the joint probabilities one can calculate marginal 
probabilities like p[i] = ^2jP[ij], which ignore the state 
of other subsystems. From these probabilities then val- 
ues for joint entropy S[IJ]/k = (— lnp[ij]), and marginal 
entropies like S[I]/k = (— lnp[i]), follow immediately. 

Mutual or correlation information between systems I 
and J, denoted here as M[I\ J] and defined by equation 
[T]as the sum of marginal entropies S[I] + S[J] minus the 
joint entropy S[IJ], thus becomes 



(3) 



From equation [3J it is easy to see that mutual informa- 
tion is the net surprisal that follows on learning that two 
systems (here I and J) are not independent. 

One interesting feature of such correlation measures is 
that they refer to the relationship between system A and 
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system B, and thus may be quite independent of mod- 
els for system A or B per se. One can also express Ya- 
neer Bar- Yam's multiscale complexity measure d 30 ' 31 by 
combining sub-system mutual information terms, with- 
out reference to uncertainty about the state of individual 
subsystems taken separately. For instance with three bi- 
nary variables (e.g. Ising model spins I, J and K), the 
amount of "intermediate scale complexity" C(2) associ- 
ated with 2 or more spins can be written as 



M[IJ\K] + M[JK\I] + M[KI\J] - M[I\J\K), (4) 

where M[I\J\K] is the three-system (all-scale) mutual 
information. Similarly the "large scale complexity" C(3) 
can be written as 

2M[I\J\K] - M[IJ\K) - M[JK\I] - M[KI\J\. (5) 



These relationships generalize nicely for N spins, via the 
fact that the sum over size-scales from 2 to N is the N- 
system mutual information. Such mutual information 
expressions also, as discussed above, connect such mul- 
tiscale measures to constraints provided by the second 
law. 

Hence the maxent formalism allows us to connect the 
isolated-system 2 nd law to observations like "If Jimmy 
and Alice didn't talk to each other, there is no way 
Jimmy could have known what Alice was planning to do." 
This assertion is about correlations between subsystems 
(Jimmy and Alice) that are quite independent of one's 
thermodynamic models for Jimmy and Alice, as are the 
multiscale complexity measures C2 and C3 above. Thus 
armed with statistical inference tools that underpin tra- 
ditional thermodynamic applications, but which require 
no physical assumptions a priori short of some state in- 
ventories, we now take a look at some of the more com- 
plex system areas where applications (already underway 
in many fields) will likely continue to develop. 

Examples of correlated subsystem pairs include pho- 
ton or electron pairs with opposite but unknown spins, 
a single strand of messenger RNA and the sequence 
of nucleotides in the gene from which it was copied, a 
manuscript and a copy of that manuscript created with 
a xerox machine (or a video camera), your understand- 
ing of a subject before being given a test and the answer 
key used by the teacher to grade that test (hopefully), 
enzymes and coenzymes with site specificity, tissue sets 
treated as friendly by your immune system, metazoans 
who developed from the same genetic blueprints (e.g. 
identical twins), families that share similar values, and 
cities which occupy similar niches in different cultures 
(e.g. sister cities). However, does this relationship be- 
tween such complex systems and the homogeneous sys- 
tems of physical thermodynamics have any consequence 
in practice? 
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FIG. 2: Graphical view of the equations underlying some ev- 
eryday thermodynamic engines. 



IV. CORRELATION PHYSICS 

The amount of entropy associated with the flow of ther- 
mal energy often dwarfs that associated with the flow of 
information, per se. For example, the 2 nd law dumps 
1/40 eV per nat of erased memory into a room temper- 
ature ambient, but this is negligible compared to other 
sources of heat in present day computers. Thus thermo- 
dynamics is seldom today a direct hindrance to informa- 
tion flow. 

On the other hand, more light on a subject (literally 
free energy to work with) rarely hinders discovery. Per- 
haps the most striking evidence of this practical connec- 
tion between thermal physics and complex systems comes 
from the correlation illustrated by Eric Chaisson, be- 
tween evolved complexity and free-energy flux density^. 
The latter is a measure of the rate at which ordered en- 
ergy is being thermalized (for the most part irreversibly) . 
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Ambient heat radiated as infrared into space 
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FIG. 3: Life's free-energy flow (left), and modes of correlation storage (right) powered by reversible thermalization of that 
energy. 



The former is evidence, on the contrary, that correlations 
are being effectively created and preserved. 

Mutual information (e.g. that two spins are correlated, 
or that two gases have not been well mixed) also plays 
a well-known role in physical system o 22 ' 32 ' 33 . There is 
recent focus in particular on its impact in nucleic acid 
replicatio n 34 ^ 5 and in quantum computin g 36 ! 37 . For ex- 
ample, Grosse et al 3 ^ use intra-molecule mutual informa- 
tion to distinguish coding and non-coding DNA, instead 
of autocorrelation functions, because the former does not 
require mapping symbols to numbers, and because it is 
sensitive to non-linear and linear dependences. Although 
constraints of this sort may be incorporated into the max- 
ent formalism, we take the possibility of such correla- 
tions into account here by including an internal mutual- 
information term I m in statements of the isolated system 
second law, namely 



dS = 



SQj, 



- SI„ 



SSi, 



(6) 



so that 5Q becomes T(dS + SI m — SSi rr ). This makes 
it possible to consider engines whose primary function 
concerns tasks not explicitly involving changes in energy, 
such as the job of putting "the kids' socks in one pile, 
and the parents' socks in another" . 

This strategy also reflects work on the energy cost 
of information in generalizing the Maxwell's demon 
problem 3 ^. ZurekiS among others suggests that the only 
requisite cost of recording information about other com- 
ponents in a system is the cost of preparing the blank 
sheet (or resetting the measuring apparatus) prior to 
recording with it. Moreover, the minimum thermody- 
namic cost, in energy per nat of correlation informa- 
tion, is simply the ambient temperature kT. A physi- 



cal example^ of this is the isothermal compressor for an 
N-atom gas (Fig. [1]) taken for the case when N=l. 

Quantitative treatment of correlated physical systems 
also leads naturally to the treatment of engines whose 
function is to produce mutual information or correlations 
between two systems. These correlations might, for ex- 
ample, be marble collections sorted by color, a faithful 
copy of a strand of DNA, or dots on a sky map corre- 
sponding to the position of stars in the night sky. Famil- 
iar first and second law engine equations then become 



dU = (SQout) - (SW in ) = 0, and 



dS = ^Q° ut - SI m = SSi, 

J- mi.f. 



> 0. 



Eliminating Q ou t from these two equations yields 



SLn < 



SWj, 
T 



(7) 



(8) 



(9) 



This means that information engines can produce no 
more mutual information than their energy consumption, 
divided by their ambient operating temperature. In bi- 
nary information units, this amounts to producing about 
55 bits of information per eV of thermalized work at room 
temperature, and around 60 bits per eV of energy if oper- 
ating near the freezing point of water. The equations for 
these engines are compared graphically to those of heat 
engines and heat pumps in Figure [5] 

Cameras, tape recorders, and copying machines may 
be considered such information engines, as are forms of 
life that take in chemical energy available for work from 
plant biomass, and thermalize that energy at ambient 
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TABLE I: "Temporally-stacked" layers of correlation-based 
complexity. 
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temperature while creating correlations between objects 
in their environment and their survival needs, or in the 
form of informed DNA sequences, songs, rituals, books, 
etc. This may in fact be a key role for living organisms 
which are not primary producers^. 

The relevance of these concepts to sustainability is il- 
lustrated in Figure [3J The top left illustrates the primary 
processes supplying free energy, while the bottom left il- 
lustrates repositories as well as paths for thermalizing 
that energy for eventual ambient radiation into space. 
The right half of Fig. [3] tracks correlations that are cre- 
ated (to the extent that this thermalization is reversible) , 
and categorizes them with (horizontal/ vertical) bars rep- 
resenting correlations looking (in/out)-ward with respect 
to the physical boundary that they relate. This story of 
emergent correlations, as a fringe benefit of otherwise 
irreversible process, fits beautifully into a much larger 
picture. 



sure, or composition), through diffusion boundaries (e.g. 
bi-layer membranes through rnetazoan skins), to gene 
and meme pool boundaries which are fiendishly complex 
but physical nonetheless. Associated with each bound- 
ary or gradient are also availability fluxes, like neutraliz- 
ing charge transported over voltage gradients, PdV work 
done in crossing pressure gradients, nutrients through cell 
walls, blood flow between tissue systems, and territorial 
flows between families. 

The approach also allows one to follow Chaisson's lead 
and discuss the emergence of complex systems in an in- 
tegrated context. One advantage of this is that we have 
"live observation" of stars, planets, and weather emerg- 
ing in many places, even if we don't yet have other exam- 
ples e.g. of biomolecule cycles giving rise to membrane- 
protected cells. Detailed "timelines of concept-relevance" 
strengthen this integrative picture, since concepts of or- 
dered energy and mutual information repeatedly inter- 
twine in non-repeating but self-similar fashion^. 

An example of this self-similarity is the invention of 
money as a ritualized reminder of expended available 
work. Another is the emergence of replicable molecu- 
lar codes complementary to the survival of cell groups, 
just as replicable ideas in human society play a role com- 
plementary to the survival of groups of individuals. 



VI. MONITORING CORRELATIONS 

A. Inventories of standing crop 

Perhaps the simplest thing to do is count. Doing this 
objectively in practice, of course, is far from trivial. Fur- 
ther, more detailed consideration (e.g. ennumeration of 
alternatives) may be necessary to put such measures into 
2 nd law terms. Nonetheless, one might sketch the outline 
of correlation measures in the following way across three 
quite different levels of complex system organization: the 
state of a molecule, a rnetazoan, and a community of in- 
dividuals. 

• (A) A correlatedstates / f ermion ^ ermions /molecule : 

• (B) ^assignments/molecule ^ -^molecules /rnetazoan: 

• (C) -^niches /rnetazoan ^ -^metazoans /community 



V. INVENTIONS, EXCITATIONS & CODES 

Begin with a hierarchical look at the evolution of com- 
plexity in time^^i. An abstract and partial outline of 
the result is provided in Table U which also attempts to 
highlight the pivotal role of spatially-defined boundaries 
and gradients in the natural history of invention. 

The standing crop of correlations in each of these cases 
involves physical boundaries of increasing complexity. 
These range from gradients (e.g. of temperature, pres- 



Presumably the first term in each case has an upper 
limit. For example, assume that individual elements each 
occupy no more than one correlated state directed in- 
ward, and/or outward, from each of the physical bound- 
ary types that comprises the level of which they are part. 

Thus with a community of individuals we might con- 
ceptualize niches as focussed inward and outward with 
respect to the boundaries of self (physical skin), fam- 
ily (gene-pool), and culture (meme-pool). Although 
the latter two boundaries between groups of correlated 
codes are geometrically complicated (to say the least), 
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they are physical boundaries nonetheless. Roles tak- 
ing care of self (skin IN), friends (skin OUT), fam- 
ily (gene-pool IN), hierarchy (gene-pool OUT), cul- 
ture (meme-pool IN), and profession (meme-pool OUT) 
have thus developed, as have (respectively) the re- 
lated lore and participant/leadership obligations of 
patient/doctor, colleague/mentor, sibling/parent, citi- 
zen/leader, dancer/priest, and professional/ scholar. In 
other words, this inventory for the case of a community 
simply asks: "In how many of these six areas are indi- 
viduals, on average, fortunate enough to be able to make 
a name for themselves?" If this is decreasing, things are 
perhaps getting worse for the community, independent of 
what other indicators have to say. 

On the level of metazoan, we might similarly consider 
molecule assignments pointing inward and outward with 
respect to molecule surface, cell-membrane, and organ. 
For example, hormone molecules required to convey sig- 
nals from one organ system to another might be seen as 
charged with an inter-tissue (organ OUT) assignment. 

On the level of an individual molecule, the relevant 
boundaries for correlated fermion states might be the 
fermion wave-packet, the appropriate nuclear or elec- 
tronic shell, and the atom comprising the molecule. Elec- 
trons involved in co-valent bonds might in this sense be 
involved in correlations directed outward from the atom 
to which they were initially assigned. Internal to atoms, 
counting correlations in second-law (mutual information) 
terms may be easier still. For example, the mutual in- 
formation between up-spin and down-spin electrons com- 
prising a He atom's K-shell is simply one bit. 

In the expressions above, the number of 
states/assignments/niches per agent is an average, 
so that each total can also be determined by a sum 
of all the states/assignments/niches in the larger unit. 
Each of the three bullets above, in sequence, attempts 
to estimate the correlation-information associated with 
order on a larger size scale. Thus each assignment of 
a metazoan molecule builds on a certain number of 
correlated fermion-states within that molecule, just as 
each niche for a community metazoan will build on 
a certain number of correlated molecule-assignments 
within that metazoan. Nonetheless each assignment or 
niche, as an emergent phenomenon, is quite distinct from 
(hence something more than) the sum of its constituent 
states or assignments, respectively. 

B. Process indicators 

Ultimately, the goal is to look at the rates at which 
the correlations above are created, minus the rates at 



which they are lost. One strategy, of course, might be to 
track the inventories above as a function of time. Those 
measures, at least, will presumably be consistent with 
other measures of these rates. 

Thanks to the 2 nd law of thermodynamics, we also 
have the fact that rates of reversible thermalization are 
less than or equal to the rates of available work used 
up. Thus the rate at which available work is fed into the 
system (hence at which something is lost in the figure 
above) offers an upper limit on the rate (when converted 
into second law terms) at which correlations are gained. 
Such energy-based measures include life's power stream 
here on earth (left side of Fig. [3]), and more generally 
Eric Chaisson's "free energy rate density"i^. 



VII. SYNTHESIS & CONCLUSIONS 

Here we've discussed net surprisal tools that can be 
applied to mutual information between parts of more 
complex systems, independent of the existence of models 
for individual subsystems per se. Such applications were 
conspicuously launched by Shannon in the late 1940's. 
Although their application in everyday and cutting-edge 
applications is expanding today at an even faster rate, 
awareness of a cross-disciplinary foundation for applying 
them remains incomplete. 

We also discuss the utility of net surprisals for treat- 
ing reversible equilibration problems (like a device for 
reversibly converting hot water into cold), and suggest 
that physical boundaries in complex systems (like code- 
pool boundaries) provide a platform for the quantitative 
monitoring of subsystem correlations in systems as com- 
plex as human communities today. The hard work of 
putting these observations to use is ahead. 
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